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Abstract 
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PsJ ■ fading channels. The long-term average transmitted rate is analyzed in a fast-fading scenario where the 

transmitter only has knowledge of channel statistics, and, consistent with contemporary wireless systems, 

D ■ 

^0 I rate adaptation is performed such that a target outage probability (after a maximum number of H-ARQ 

. rounds) is maintained. H-ARQ allows for early termination once decoding is possible, and thus is a 

coarse, and implicit, mechanism for rate adaptation to the instantaneous channel quality. Although the 

rate with H-ARQ is not as large as the ergodic capacity, which is achievable with rate adaptation to 

tyj ' the instantaneous channel conditions, even a few rounds of H-ARQ make the gap to ergodic capacity 

reasonably small for operating points of interest. Furthermore, the rate with H-ARQ provides a significant 

ff^ . advantage compared to systems that do not use H-ARQ and only adapt rate based on the channel statistics. 
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I. Introduction 

ARQ (automatic repeat request) is an extremely powerful type of feedback-based communication that 
is extensively used at different layers of the network stack. The basic ARQ strategy adheres to the pattern 
of transmission followed by feedback of an ACK/NACK to indicate successful/unsuccessful decoding. 
If simple ARQ or hybrid- ARQ (H-ARQ) with Chase combining (CC) [1] is used, a NACK leads to 



5h ' retransmission of the same packet in the second ARQ round. If H-ARQ with incremental redundancy 

(IR) is used, the second transmission is not the same as the first and instead contains some "new" 
information regarding the message (e.g., additional parity bits). After the second round the receiver again 
attempts to decode, based upon the second ARQ round alone (simple ARQ) or upon both ARQ rounds 
(H-ARQ, either CC or IR). The transmitter moves on to the next message when the receiver correctly 
decodes and sends back an ACK, or a maximum number of ARQ rounds (per message) is reached. 

ARQ provides an advantage by allowing for early termination once sufficient information has been 
received. As a result, it is most useful when there is considerably uncertainty in the amount/quality 
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of information received. At the network layer, this might correspond to a setting where the network 
congestion is unknown to the transmitter. At the physical layer, which is the focus of this paper, this 
corresponds to a fading channel whose instantaneous quality is unknown to the transmitter. 

Although H-ARQ is widely used in contemporary wireless systems such as HSPA [2], WiMax [3] 
(IEEE 802. 16e) and 3GPP LTE [4], the majority of research on this topic has focused on code design, 
e.g., [5], [6], [7], while relatively little research has focused on performance analysis of H-ARQ [8]. 
Most relevant to the present work, in [9] Caire and Tuiunetti established a relationship between H-ARQ 
throughput and mutual information in the limit of infinite block length. For multiple antenna systems, 
the diversity-multiplexing-delay tradeoff of H-ARQ was studied by El Gamal et al. [10], and the coding 
scheme achieving the optimal tradeoff was introduced; Chuang et al. [11] considered the optimal SNR 
exponent in the block-fading MIMO (multiple-input multiple-output) H-ARQ channel with discrete input 
signal constellation satisfying a short-term power constraint. H-ARQ has also been recently studied in 
quasi-static chaimels (i.e., the chaimel is fixed over all H-ARQ rounds) [12], [13] and shown to bring 
benefits to secrecy [14]. 

In this paper we build upon the results of [9] and perform a mutual information-based analysis of H- 
ARQ in block-fading chaimels. We consider a scenario where the fading is too fast to allow instantaneous 
channel quality feedback to the transmitter, and thus the transmitter only has knowledge of the channel 
statistics, but nonetheless each transmission experiences only a limited degree of channel selectivity. In 
this setting, rate adaptation can only be performed based on channel statistics and achieving a reasonable 
error/outage probability generally requires a conservative choice of rate if H-ARQ is not used. On the 
other hand, H-ARQ allows for implicit rate adaptation to the instantaneous channel quality because the 
receiver terminates transmission once the chaimel conditions experienced by a codeword are good enough 
to allow for decoding. 

We analyze the long-term average transmitted rate achieved with H-ARQ, assuming that there is a 
maximum number of H-ARQ rounds and that a target outage probability at H-ARQ termination cannot 
be exceeded. We compare this rate to that achieved without H-ARQ in the same setting as well as to 
the ergodic capacity, which is the achievable rate in the idealized setting where instantaneous channel 
information is available to the transmitter. The main findings of the paper are that (a) H-ARQ generally 
provides a significant advantage over systems that do not use H-ARQ but have an equivalent level of 
channel selectivity, (b) the H-ARQ rate is reasonably close to the ergodic capacity in many practical 
settings, and (c) the rate with H-ARQ is much less sensitive to the desired outage probability than an 
equivalent system that does not use H-ARQ. 
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The present work differs from prior literature in a number of important aspects. One key distinction is 
that we consider systems in which the rate is adapted to the average SNR such that a constant target outage 
probabiUty is maintained at all SNR's, whereas most prior work has considered either fixed rate (and thus 
decreasing outage) [11] or increasing rate and decreasing outage as in the diversity-multiplexing tradeoff 
framework [10] [15]. The fixed outage paradigm is consistent with contemporary wireless systems where 
an outage level near 1% is typical (see [16] for discussion), and certain conclusions depend heavily on 
the outage assumption. With respect to [9], note that the focus of [9] is on multi-user issues, e.g., whether 
or not a system becomes interference-limited at high SNR in the regime of very large delay, whereas 
we consider single-user systems and generally focus on performance with short delay constraints (i.e., 
maximum number of H-ARQ rounds). In addition, we use the attempted transmission rate, rather than 
the successful rate (which is used in [9]), as our performance metric. This is motivated by applications 
such as Voice-over-IP (VoIP), where a packet is dropped (and never retransmitted) if it cannot be decoded 
after the maximum number of H-ARQ rounds and quality of service is maintained by achieving the target 
(post-H-ARQ) outage probability. On the other hand, reliable data communication requires the use of 
higher-layer retransmissions whenever H-ARQ outages occur; in such a setting, the relevant metric is the 
successful rate, which is the product of the attempted transmission rate and the success probability (i.e., 
one minus the post-H-ARQ outage probability). If the post-H-ARQ outage is fixed to some target value 
(e.g., 1%), then studying the attempted rate is effectively equivalent to studying the successful rateQ 

II. System Model 

We consider a block-fading channel where the channel remains constant over a block but varies 
independently from one block to another. The t-th received symbol in the i-th block is given by: 



where the index i = 1, 2, • • • indicates the block number, t = 1, 2, • • • , T indexes channel uses within a 
block, SNR is the average received SNR, hi is the fading channel coefficient in the i-th block, and xt^i, yt,i, 
and zt^i are the transmitted symbol, received symbol, and additive noise, respectively. It is assumed that 
/ifc is complex Gaussian (circularly symmetric) with unit variance and zero mean, and that hi,h2, ■ ■ ■ are 
i.i.d.. The noise zt^i has the same distribution as and is independent across channel uses and blocks. 

'if the post-H-ARQ outage probability can be optimized, then a careful balancing between the attempted rate and higher-layer 
retransmissions should be conducted in order to maximize the successful rate. Although this is beyond the scope of the present 
paper, note that some results in this direction can be found in [17] [18]. 
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The transmitted symbol xt^i is constrained to have unit average power; we consider Gaussian inputs, and 
thus xt^i has the same distribution as the fading and the noise. Although we focus only on Rayleigh fading 
and single antenna systems, our basic insights can be extended to incorporate other fading distributions 
and MIMO as discussed in Section HVl (Remark 1). 

We consider the setting where the receiver has perfect channel state information (CSI), while the 
transmitter is aware of the channel distribution but does not know the instantaneous channel quality. 
This models a system in which the fading is too fast to allow for feedback of the instantaneous channel 
conditions from the receiver back to the transmitter, i.e., the channel coherence time is not much larger 
than the delay in the feedback loop. In cellular systems this is the case for moderate-to-high velocity users. 
This setting is often referred to as open-loop because of the lack of instantaneous channel tracking at the 
transmitter, although other forms of feedback, such as H-ARQ, are permitted. The relevant performance 
metrics, notably what we refer to as outage probability and fixed outage transmitted rate, are specified 
at the beginning of the relevant sections. 

If H-ARQ is not used, we assume each codeword spans L fading blocks; L is therefore the channel 
selectivity experienced by each codeword. When H-ARQ is used, we make the following assumptions: 

• The channel is constant within each H-ARQ round (T symbols), but is independent across H-ARQ 
rounds]^ 

• A maximum of M H-ARQ rounds are allowed. An outage is declared if decoding is not possible 
after M rounds, and this outage probability can be no larger than the constraint e. 

Because the channel is assumed to be independent across H-ARQ rounds, M is the maximum amount of 
channel selectivity experienced by a codeword. When comparing H-ARQ and no H-ARQ, we set L = M 
such that maximum selectivity is equalized. 

It is worth noting that these assumptions on the channel variation are quite reasonable for the fast- 
fading/open-loop scenarios. Transmission slots in modem systems are typically around one millisecond, 
during which the channel is roughly constant even for fast fading. ^ An H-ARQ round generally cor- 

^An intuitive but somewhat misleading extension of the quasi-static fading model to the H-ARQ setting is to assume that 
the channel is constant for the duration of the H-ARQ rounds corresponding to a particular message/codeword, but is drawn 
independently across different messages. Because more H-ARQ rounds are needed to decode when the channel quality is poor, 
such a model actually changes the underlying fading distribution by increasing the probability of poor states and reducing the 
probability of good chaimel states. In this light, it is more accurate model the channel across H-ARQ rounds according to a 
stationary and ergodic random process with a high degree of correlation. 

^Frequency-domain channel variation within each H-ARQ round is briefly discussed in Section HV-BI 
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responds to a single transmission slot, but subsequent ARQ rounds are separated in time by at least a 
few slots to allow for decoding and ACK/NACK feedback; thus the assumption of independent channels 
across H-ARQ rounds is reasonable. Moreover, a constraint on the number of H-ARQ rounds limits 
complexity (the decoder must retain information received in prior H-ARQ rounds in memory) and delay. 

Throughout the paper we use the notation F^^{X) to denote the solution y to the equation F[X < 
y] = e, where X is a random variable; this quantity is well defined wherever it is used. 

III. Performance Without H-ARQ: Fixed-Length Coding 

We begin by studying the baseline scenario where H-ARQ is not used and every codeword spans L 
fading blocks. In this setting the outage probability is the probability that mutual information received 
over the L fading blocks is smaller than the transmitted rate R [19, eq (5.83)]: 



Pout(i?,SNR) =P 



1 ^ 

-^log2(l +SNR|/ii|2) < R 



L 



(2) 



where hi is the channel in the i-th fading block. The outage probability reasonably approximates the 
decoding error probability for a system with strong coding [20] [21], and the achievability of this error 
probability has been rigorously shown in the limit of infinite block length (T oo) [22] [23]. 

Because the outage probability is a non-decreasing function of R, by setting the outage probability to 
e and solving for R we get the following straightforward definition of e-outage capacity [24]: 

Definition 1: The e-outage capacity with outage constraint e and diversity order L, denoted by Cf^(SNR), 
is the largest rate such that the outage probability in (|2]) is no larger than e: 

Cf-CSNR) = max R (3) 

Po„,(i?,SNR)<£ 

Using notation introduced earlier, the e-outage capacity can be rewritten as 

Cf'(SNR) = |^i^log2(l+SNR|/li|2)^ (4) 



log2 SNR + F^M T > . log2 ( + 1^*1 ) I ■ (5) 




For L = 1, PoutiR, SNr) can be written in closed form and inverted to yield Cg^(SNR) = log2 ^1 + logg yj^j SNR^ 
[19]. For L > 1 the outage probability cannot be written in closed form nor inverted, and therefore 
Cf'(SNR) must be numerically computed. There are, however, two useful approximations to e-outage 
capacity. The first one is the high-SNR affine approximation [25], which adds a constant rate offset term 
to the standard multiplexing gain characterization. 



September 17, 2009 



DRAFT 



6 



Theorem 1: The high-SNR affine approximation to e-outage capacity is given by 

(6) 



where the notation implies that the o(l) term vanishes as SNR oo. 

Proof: The proof is identical to that of the high-SNR offset characterization of MIMO channels 
in [26, Theorem 1], noting that single antenna block fading is equivalent to a MIMO channel with a 
diagonal channel matrix. ■ 
In terms of standard high SNR notation where C(snr) = 5oo(log2SNR - £oo) + o{l) [25][27], the 
multiplexing gain Soo = 1 and the rate offset Coo = —F^^ (^xSi=i^°S2 (l^jP)^ The rate offset is 
the difference between the e-outage capacity and the capacity of an AWGN channel with signal-to-noise 
ratio SNR. Although a closed form expression for £oo cannot be found for L > 1, from [28], 



jY.^og,{\K\')< 



L 

i=l 



2.L^y^^ (2^^|g,o,...,o,-i) > (7) 



where G^^l^ y^lbl' t") Meijer G-function [29, eq. (9.301)]. Based on ([6]), £oo therefore is the 

solution to 2^'~°°^G^'l_^-^ (2^^=°^|Qg o-i) ~ ^- The rate offset Coo is plotted versus L in Fig. [T] for 
e = 0.01. As L — > oo the offset converges to — E[log2 ~ 0.83, the offset of the ergodic Rayleigh 

channel [27]. 

While the affine approximation is accurate at high SNR's, motivated by the Central Limit Theorem 
(CLT), an approximation that is more accurate for moderate and low SNR's is reached by approximating 
random variable 7; X^^li log2(l + SNR|/ijp) by a Gaussian random variable with the same mean and 
variance [30][31]. The mean /x and variance cj^ of log2(l + SNR|/ip) are given by [32][33]: 

^(SNR) = E[log2{l+sm\h\^)]=log2{e)e^^^^^Ei{l/sm), (8) 
a\sm) = ^logi(e)eVSNRGjo (l/sNR|°;°'° -/.^(SNR), (9) 

where Ei{x) = t~^e^''^^dt, and at high SNR the standard deviation (j(snr) converges to ^^"^ ^ [33]. 
The mutual information is thus approximated by a AA(;u(snr), (SNR) therefore 

Pout (i?, SNR) «Q (^^(/i(SNR)-i?)) , (10) 

where Q{-) is the tail probability of a unit variance normal. Setting this quantity to e and then solving 
for R yields an e-outage capacity approximation [30, eq. (26)]: 

C^SNR) « ^(SNR) - ^^Q-l(e). (11) 
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The accuracy of this approximation depends on how accurately the CDF of a Gaussian matches the 
CDF (i.e., outage probability) of random variable J2i=i log2(l + SNR|/ijp). In Fig. |2]both CDF's are 
plotted for L = 2 and L = 10, and SNR = 0, 10, and 20 dB. As expected by the CLT, as L increases the 
approximation becomes more accurate. Furthermore, the match is less accurate for very small values of e 
because the tails of the Gaussian and the actual random variable do not precisely match. Finally, note that 
the match is not as accurate at low SNR's: this is because the mutual information random variable has a 
density close to a chi-square in this regime, and is thus not well approximated by a Gaussian. Although 
not accurate in all regimes, numerical results confirm that the Gaussian approximation is reasonably 
accurate for the range of interest for parameters (e.g., 0.01 < e < 0.2 and < SNR < 20 dB). More 
importantly, this approximation yields important insights. 

In Fig. [3] the true e-outage capacity C/^(snr) and the affine and Gaussian approximations are plotted 
versus SNR for e = 0.01 and L = 3, 10. The Gaussian approximation is reasonably accurate at moderate 
SNR's, and is more accurate for larger values of L. On the other hand, the affine approximation, which 
provides a correct high SNR offset, is asymptotically tight at high SNR. 

A. Ergodic Capacity Gap 

When evaluating the effect of the diversity order L, it is useful to compare the ergodic capacity /x(snr) 
and C^^(snr). By Chebyshev's inequality, for any < u; < ^, 

1 ^ 

//(SNR) - -^log2(l + SNR 



i=l 



> W 



By replacing w with /i(SNR) — R and equating the right hand side (RHS) with e, we get 

cr(SNR) , . , , cr(SNR) 

^(SNR) ^--=J- < C^SNR) < ^(SNR) + ^ ' . (13) 



This implies C/^(snr) /i(SNR) as L ^ oo, as intuitively expected; reasonable values of e are smaller 
than 0.5, and thus we expect convergence to occur from below. 

In order to capture the speed at which this convergence occurs, we define the quantity Aec-fd as the 
difference between the ergodic and e-outage capacities. Based on (fT3l) we can upper bound Aec-fd as: 

Aec-Fd(SNR) = /i(SNR) - Cf'(SNR) < ^i^. (14) 



This bound shows that the rate gap goes to zero at least as fast as O [l/y/Ly Although we cannot 
rigorously claim that Aec-fd is of order 1/\/L, by (fTTI) the Gaussian approximation to this quantity is: 

Aec-fd(snr) « 1^^Q-\e), (15) 
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which is also O yl/^/Ly This approximation becomes more accurate as L ^ oo, by the CLT, and thus 
is expected to correctly capture the scaling with L. Note that (fTSl ) has the interpretation that the rate must 
be ^ deviations below the ergodic capacity /x(snr) in order to ensure 1 — e reliability. In Fig. |4]the 
actual capacity gap and the approximation in (fTSl ) are plotted for e = 0.01 and e = 0.05 with SNR = 20 
dB, and a reasonable match between the approximation and the exact gap is seen. 

IV. Performance with Hybrid-ARQ 

We now move on to the analysis of hybrid-ARQ, which will be shown to provide a significant 
performance advantage relative to the baseline of non-H-ARQ performance. H-ARQ is clearly a variable- 
length code, in which case the average transmission rate must be suitably defined. If each message contains 
h information bits and each ARQ round corresponds to T channel symbols, then the initial transmission 
rate is Ri^^ = ^ bits/symbol. If random variable Xi denotes the number of H-ARQ rounds used for 
the i-th message, then a total of '}2,^=i H-ARQ rounds are used and the average transmission rate (in 
bits/symbol or bps/Hz) across those N messages is: 

We are interested in the long-term average transmission rate, i.e., the case where — > oo. By the law 
of large numbers (note that the Xj's are i.i.d. in our model), -^Yl,i=i^i ~^ and thus the rate 

converges to 

bits/symbol (17) 



Here X is the random variable representing the number of H-ARQ rounds per message; this random 
variable is determined by the specifics of the H-ARQ protocol. 

In the remainder of the paper we focus on incremental redundancy (IR) H-ARQ because it is the most 
powerful type of H-ARQ, although we compare IR to Chase combining in Section IIV-EI In [9] it is 
shown that mutual information is accumulated over H-ARQ rounds when IR is used, and that decoding 
is possible once the accumulated mutual information is larger than the number of information bits in the 
message. Therefore, the number of H-ARQ rounds X is the smallest number m such that: 

m 

log2(l + SNR|/ii|2) > R,^,,. (18) 

j=l 

The number of rounds is upper bounded by M, and an outage occurs whenever the mutual information 
after M rounds is smaller than i?init: 



pIR,M ( p 



M 



J]]log2(l +SNR|/ii|2) < R;, 



.1=1 



(19) 
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This is the same as the expression for outage probability of M-order diversity without H-ARQ in ([2]), 
except that mutual information is summed rather than averaged over the M rounds. This difference is a 
consequence of the fact that R\aii is defined for transmission over one round rather than all M rounds; 
dividing by E[X] in ([TT]) to obtain the average transmitted rate makes the expressions consistent. Due 
to this relationship, if the initial rate is set as R\an = M ■ C^'^ , where C^^ is the e-outage capacity for 
M-order diversity without H-ARQ, then the outage at H-ARQ termination is e. 

In order to simplify expressions, it is useful to define Afc(i?init) as the probability that the accumulated 
mutual information after k rounds is smaller than i?init: 



^jk(-Rinit) — 



(20) 



^log2(l + SNR|/li|2) < 
.i=l 

The expected number of H-ARQ rounds per message is therefore given by: 

M-l A/-1 

E[X] = 1 + ^ P[X > A;] = 1 + ^ ^fc(iimit). (21) 

k=l k=l 

The long-term average transmitted rate, which is denoted as C^^'^ , is defined by ([TT] ). With initial 

Cf'^i ^^=( J^) . (22) 



rate R„;t = M • Ci" we have! 



E[X] \E[X] 

Note that Ce^'^^ is the attempted long-term average transmission rate, as discussed in Section H For the 
sake of brevity this quantity is referred to as the H-ARQ rate; this is not to be confused with the initial 
rate i?init. Similarly, we refer to e-outage capacity C^^ as the non-H-ARQ rate in the rest of the paper. 

Because E[X] < M, the H-ARQ rate is at least as large as the non-H-ARQ rate, i.e., Cf'^'^ > C*^, 
and the advantage with respect to the non-H-ARQ benchmark is precisely the multiplicative factor 
This difference is explained as follows. Because R\aii = M ■ C*^, each message/packet contains C^^ MT 
information bits regardless of whether H-ARQ is used. Without H-ARQ these bits are always transmitted 
over MT symbols, whereas with H-ARQ an average of only E[X]T symbols are required. 

In Fig. |5]the average rates with {C^^'^^) and without H-ARQ (C^) are plotted versus SNR for e = 0.01 
and M = 1, 2 and 6 (M = 1 does not allow for H-ARQ in our model). Ergodic capacity is also plotted 
as a reference. Based on the figure, we immediately notice: 

• H-ARQ with 6 rounds outperforms H-ARQ with 2 rounds. 

''ah quantities in this expression except M are actually functions of SNR. For the sake of compactness, however, dependence 
upon SNR is suppressed in this and subsequent expressions, except where explicit notation is necessary. 
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• H-ARQ provides a significant advantage relative to non-H-ARQ for the same value of M for a wide 
range of SNR's, but this advantage vanishes at high SNR. 
Increasing rate with M is to be expected, because larger M corresponds to more time diversity and 
more early termination opportunities. The behavior with respect to SNR is perhaps less intuitive. The 
remainder of this section is devoted to quantifying and explaining the behavior seen in Fig. |5] We begin 
by extending the Gaussian approximation to H-ARQ, then examine performance scaling with respect to 
M, SNR, and e, and finally compare IR to Chase Combining. 

A. Gaussian Approximation 

By the definition of Ak{-) and (l2T])-(|22l), the H-ARQ rate can be written as: 

^1R,M _ ^A-f (^) /oox 

^+Y:t\'A,[A,iie)y 

where A~^l{-) refers to the inverse of function Am{-)- If we use the approach of Section |lll] and 
approximate the mutual information accumulated in k rounds by a Gaussian with mean ^ik and variance 
cr^fc, where ^ and cr^ are defined in ([8]) and (|9]), we have: 

^.(i?™t) « Q ( ^^"5" ! . (24) 

. Applying 

the approximation of Afc(i?init) to each term in ( |23] ) and using the property 1 — Q{x) = Q{—x) yields: 



a^/k 

Similar to (fTTI ). the initial rate i?init = A'^ji^e) can be approximated as M /i — -^(^^^(e 



M 



(25) 



This approximation is easier to compute than the actual H-ARQ rate and is reasonably accurate. Further- 
more, it is useful for the insights it can provide. 

B. Scaling with H-ARQ Rounds M 

In this section we study the dependence of the H-ARQ rate on M. We first show convergence to the 
ergodic capacity as M ^ oo: 

Theorem 2: For any SNR, the H-ARQ rate converges to the ergodic capacity as M — > oo: 



lim Cf '^^^ (SNR) = ;u(SNR) (26) 

M^oo 



Proof: See Appendix A. 
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To quantify how fast this convergence is, similar to Section IIII-AI we investigate the difference between 
the ergodic capacity and the H-ARQ rate. Defining Aec-ir — ^(snr) — Ce^'^^(SNR) we have 

A.c-a ^ (e[X1 - ^) . ^ (e[X, - (m - (27) 



where the approximation follows from C^^ ^ ^~^^/m' ^^'^^u^^ E[X] is on the order of M (as 



established in the proof of Theorem|2l), the key is the behavior of the term E[X] — {^M — ^(5^^(e)\/M 

To better understand M[X] we again return to the Gaussian approximation. While the CDF of X is 
defined hy F {X < k) = 1 — Ak{Rimt) (for A; = 1, . . . , M — 1), we use X to denote the random variable 
using the Gaussian approximation and thus define its CDF (for integers k) as: 



^ \ a\/k 



(28) 



where we have used Ak{Rink) ~ Q ( ^^v^"" ) ^"^^^^^^^^ ^'^'t = MC^^ ^ Mfi - y/MaQ-^{e). 



From this expression, we can immediately see that the median of X is M — -Q ^(e)\/M 



was equal to the mean of X, then by (l27l) the rate difference would be well approximated by where 



[34]. If this 



j3 is the difference between M - ^Q-'^{e)VM and (^M - ^Q-^{e)\^j and thus is no larger than 
one. By studying the characteristics of X (and of X) we can see that the median is in fact quite close 
to the mean. A tedious calculation in Appendix B gives the following approximation to E[X]: 

("OO 

E[X] w M --Q-i(e)VM + 0.5(1 - e) - -\/M / Q{x)dx, (29) 

which is reasonably accurate for large M. The most important factor is the term 0.5(1 — e), which is due 
to the fact that only an integer number of H-ARQ rounds can be used. The factor — ^\/M Q{x)dx 
exists because the random variable is truncated at the point where its CDF is 1 — e. 
Applying this into (1271) . the rate difference can be approximated as: 

^(0.5(l-e)-^./M/-.(^)Q(x)dx) 
M-fQ-^{e)VM-fVMf^^,^^^Q{x)dx + 0.5{l-e) 



The denominator increases with M at the order of M (more precisely as M — y M), while the numerator 
actually decreases with M and can even become negative if M is extremely large. For reasonable values 
of M, however, the negative term in the numerator is essentially inconsequential (for example, if e = 0.01 
and SNR = 10 dB, the negative term is much smaller than 0.5(1 — e) for M < 5000) and thus can be 
reasonably neglected. By ignoring this negative term and replacing the denominator with the leading 
order M term, we get a further approximation of the rate gap: 

^ 0.5(1 -6)/x 

^EC-IR ~ (-5 1) 
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Based on this approximation, we see that the rate gap decreases roughly on the order O (1/M), rather 
than the O ^1/ \/M^ decrease without H-ARQ. In Fig. [6] we plot the exact capacity gap with and without 
H-ARQ, as well as the Gaussian approximation to the H-ARQ gap (l30l) and its simplified form in (|3T]) 
for e = 0.01 at SNR = 10 dB. Both approximations are seen to be reasonably accurate especially for 
large M. In the inset plot, which is in log-log scale, we see that the exact capacity gap goes to zero at 
order 1/M, consistent with the result obtained from our approximation. 

The fast convergence with H-ARQ can be intuitively explained as follows. If transmission could be 
stopped precisely when enough mutual information has been received, the transmitted rate would be 
exactly matched to the instantaneous mutual information and thus ergodic capacity would be achieved. 
When H-ARQ is used, however, transmission can only be terminated at the end of a round as, opposed 
to within a round, and thus a small amount of the transmission can be wasted. This "rounding error", 
which is reflected in the 0.5(1 — e) term in ( [30l ) and (|3T| ). is essentially the only penalty incurred by 
using H-ARQ rather than explicit rate adaptation. 

Remark 1: Because the value of H-ARQ depends primarily on the mean and variance of the mutual 
information in each H-ARQ round, our basic insights can be extended to multiple-antenna channels and 
to channels with frequency (or time) diversity within each ARQ round if the change in mean and variance 
is accounted for. For example, with order F frequency diversity the mutual information in the i-th H- 
ARQ round becomes j; Yli=i log(l + SNR|/ij where hi^i is the channel in the i-th round on the l-th 
frequency channel. The mean mutual information is unaffected, while the variance is decreased by a 
factor of -pr. 

C. Scaling with SNR 

In this section we quantify the behavior of H-ARQ as a function of the average SNR^ Fig. [5] indicated 
that the benefit of H-ARQ vanishes at high SNR, and the following theorem makes this precise: 

Theorem 3: If SNR is taken to infinity while keeping M fixed, the expected number of H-ARQ 
rounds converges to M and the H-ARQ rate converges to C^^{snr), the non-H-ARQ rate with the 

^ Because constant outage corresponds to the full-multiplexing point, the results of [10] imply that C'"^'*^ cannot have 
a multiplexing gain/pre-log larger than one (in [10] it is shown that H-ARQ does not increase the full multiplexing point). 
However, the DMT-based results of [10] do not provide rate-offset characterization as in Theorems [3] and ID 
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same selectivity: 

lim mX]=M (32) 

SNR^oo 

lim [Cf '*^(snr) - C5(snr)1 = (33) 
Proof: See Appendix C. ■ 

The intuition behind this result can be gathered from Fig. |7J where the CDF's of the accumulated 
mutual information after 2 and 3 rounds are plotted for for SNR = 10 and 40 dB. If M = 3 the initial rate 
is set at the e-point of the CDF of Yll=i log(l + SNR|/iip). Because the CDF's overlap for M = 2 and 
M = 3 considerably when SNR = 10 dB, there is a large probability that sufficient mutual information 
is accumulated after 2 rounds and thus early termination occurs. However, the overlap between these 
CDF's disappears as SNR increases, because l^^=ilog(l + SNR|/iip) k. A: log SNR + log(|/iip), and 
thus the early termination probability vanishes. 

Although the H-ARQ advantage eventually vanishes, the advantage persists throughout a large SNR 
range and the Gaussian approximation (Section IIV-AI ) can be used to quantify this. The probability of 
terminating in strictly less than M rounds is approximated by: 

nX<M-l] . -(^^''"^",^17^"^"'^^^) (34) 

In order for this approximation to be greater than one -half we require the numerator inside the Q-function 
to be less than zero, which corresponds to 

^<^IQ-\e) or Vm> /^^n U . (35) 
cj(snr) cj(SNR)Q-i(e) 

As SNR increases //(snr) increases without bound whereas cr(SNR) converges to a constant. Thus /i(SNR)/(T(SNR) 

increases quickly with SNR, which makes the probability of early termination vanish. From this we see 

that the H-ARQ advantage lasts longer (in terms of SNR) when M is larger. The second inequality in 

(|35] ) captures an alternative viewpoint, which is roughly the minimum value of M required for H-ARQ 

to provide a significant advantage. 

Motivated by naive intuition that the H-ARQ rate is monotonically increasing in the initial rate -Rinit, up 

to this point we have chosen i?init = MC^^ = A^^{e) such that outage at H-ARQ termination is exactly 

e. However, it turns out that the H-ARQ rate is not always monotonic in Rmii- In Fig. [H the H-ARQ rate 

is plotted versus initial rate i?init for M = 2, 3, and 4 for SNR = 10 dB (left) and 30 dB (right). At 

10 dB, ^fflSj monotonically increases with Ri^a and thus there is no advantage to optimizing the initial 

rate. At 30 dB, however, behaves non-monotonically with i?init- We therefore define C'e'^'^^(SNR) 
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as the maximized H-ARQ rate, where the maximization is performed over all values of initial rate i?init 
such that the outage constraint e is not violated: 

Cf'^(SNR)4 max (36) 

The local maxima seen in Fig. [8] appear to preclude a closed form solution to this maximization. Although 
optimization of the initial rate provides an advantage over a certain SNR range, the following theorem 
shows that it does not provide an improvement in the high-SNR offset: 

Theorem 4: H-ARQ with an optimized initial rate, i.e., (^^^'^^(snr), achieves the same high-SNR 
offset as unoptimized H-ARQ Ce'^'^^(SNR) 



lim 

SNR^cxD 



ClM^(SNR)-Cf'*^(SNR) 



(37) 



Furthermore, the only initial rate (ignoring o(l) terms) that achieves the correct offset is the unoptimized 
value i?ini, = MC^. 

Proof: See Appendix D. ■ 
In Fig. |9l rates with and without optimization of the initial rate are plotted for e = 0.01 and M = 2,6. 
For M = 2 optimization begins to make a difference at the point where the unoptimized curve abruptly 
decreases towards C^^ around 25 dB, but this advantage vanishes around 55 dB. For M = 6 the advantage 
of initial rate optimization comes about at a much higher SNR, consistent with (l35l ). Convergence of 
C'e^'^(SNR) to Ce^'^(SNR) does eventually occur, but is not visible in the figure. 

D. Scaling with Outage Constraint e 

Another advantage of H-ARQ is that the H-ARQ rate is generally less sensitive to the desired outage 
probability e than an equivalent non-H-ARQ system. This advantage is clearly seen in Fig. [TOl where 
the H-ARQ and non-H-ARQ rates are plotted versus e for M = 5 at SNR = 0, 10 and 20 dB. When e 
is large (e.g., roughly around 0.5) H-ARQ provides almost no advantage: a large outage corresponds to 
a large initial rate, which in turn means early termination rarely occurs. However, for more reasonable 
values of e, the H-ARQ rate is roughly constant with respect to e whereas the non-H-ARQ rate decreases 
sharply as e — > 0. The transmitted rate must be decreased in order to achieve a smaller e (with or without 
H-ARQ), but with H-ARQ this decrease is partially compensated by the accompanying decreasing in the 
number of rounds E[X]. 
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E. Chase Combining 

If Chase combining is used, a packet is retransmitted whenever a NACK is received and the receiver 
performs maximal-ratio-combining (MRC) on all received packets. As a result, SNR rather the mutual 
information is accumulated over H-ARQ rounds and the outage probability is given by: 



-fout ' (^init) — IP 



log2 ^l + SNR^|/l,|2^ < ii„ 



(38) 



For outage e, the initial rate is R\^m = log2 + l^jPj SNrJ 

Different from IR, the expected number of H-ARQ rounds in CC is not dependent on SNR and thus 
the average rate for outage e can be written in closed form: 



aCC'*^(SNR)= , 



where the denominator is E[X]. According to (|39l ). we can get the high SNR affine approximation as: 

Because E[X] > 1 for any positive outage value, the pre-log factor (i.e., multiplexing gain) is j^p^ 
and thus is less than one. This implies that CC performs poorly at high SNR. This is to be expected 
because CC is essentially a repetition code, which is spectrally inefficient at high SNR. As with IR, the 
performance of CC at high SNR can be improved through rate optimization. At high SNR, the pre-log 
is critical and thus the initial rate should be selected so that E[X] is close to one and thereby avoiding 
H-ARQ altogether. Even with optimization, CC is far inferior to IR at moderate and high SNR's. On the 
other hand, CC performs reasonably well at low SNR. This is because log(l + x) « x for small values 
of X, and thus SNR-accumulation is nearly equivalent to mutual information-accumulation. In Fig. [TT] 
rate-optimized IR and CC are plotted for M = 2, 4 and e = 0.01, and the results are consistent with the 
above intuitions. 

V. Conclusion 

In this paper we have studied the performance of hybrid-ARQ in the context of an open-loop/fast- 
fading system in which the transmission rate is adjusted as a function of the average SNR such that a 
target outage probability is not exceeded. The general findings are that H-ARQ provides a significant rate 
advantage relative to a system not using H-ARQ at reasonable SNR levels, and that H-ARQ provides a 
rate quite close to the ergodic capacity even when the channel selectivity is limited. 
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There appear to be some potentially interesting extensions of this work. Contemporary cellular systems 
utilize simple ARQ on top of H-ARQ, and it is not fully understood how to balance these reliability 
mechanisms; some results in this direction are presented in [17]. Although we have assumed error-free 
ACK/NACK feedback, such errors can be quite important (c.f., [35]) and merit further consideration. 
Finally, while we have considered only the mutual information of Gaussian inputs, it is of interest to 
extend the results to discrete constellations and possibly compare to the performance of actual codes. 
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Appendix I 
PROOF OF THEOREM 2 

^Y\^e^ ^^'^ limM-»oo = (Scction [lII-Al l. we can prove lim 



M^oo — ^J' 



by showing limj\/^oo = 1- Because E[X] < M, we can show this simply by showing E[X] is of 
order M. For notational convenience we define Yi = log2(l + SNR|/ijp), and then have: 



A/-1 



E[X] 



> 



> 1 + 



k=l 

\M-AIi 

E 

k=l 



.1=1 



fWeJ 



.i=l 




> 1+\M- M' 



E 

i=l 



M 

Yi < Mfi - a\j — 



/Me 



where the first line holds because E[X] is increasing in Rimt and i?init = MC^ > M y^i 
(|T3] ). the second holds because the summands are non-negative, and the last line because the summands 



(41) 



(42) 



(43) 



from 



are decreasing in k. A direct application of the CLT shows 



M — > oo, and thus, with some straightforward algebra, we have limjv/ 



1. 



M 



1 as 



Appendix H 
PROOF OF (1291) 

Firstly, we relax the constraint on X (discreteness and finiteness) to define a new continuous random 
variable X, which is distributed along the whole real line. The CDF of X (for all real x) is 

( li{M ~ x) - ^aQ-^{e) \ 



X <x 



Q 



Ox X 



(44) 
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Now if we consider the distribution of X — (M— j^Q ^(e)\/Mj, we have 



X-[M - -Q-\e)VMj < X 



Q 



-fix 



aJM -^Q-^{e)VM + x ^ 



(45) 



where the equality follows from (041). Notice as M ^ oo, JM - ^Q-i(e)\/M + x ^ \/M, so 



Q 



-fJLX 



aJM - ^Q-\e)y/M + x 



Q 



-fjLX 



(46) 



where <!>(•) is the standard normal CDF with zero mean and unit variance. So as M —>■ oo, the limiting 



distribution of X, denoted by 4>(-), goes to M - ^Q-'^{e)^/M, (^^^ Mj, which is 

'x-(M-f-Q-\e)VM) 



for X £ 



(47) 



Since E[X] is an approximation to E[X], then we focus on evaluating E[X] for large M: 

M-l M-1 M-1 

E[X] = (l-¥[X <k]) = M - ^(k) = M-Yj 



dx - 0.5(1 - e) 




+ 0.5(1 - e) 



(48) 



where (a) holds since <l(/c) = $(/c) when k = 1, 2, • • • , M - 1 and (b) follows from ^{M) = 1 - e 
and ^(1) is negligible when M is large enough. Actually, the first integral in ( |48] ) can be evaluated as 
^(5^^(e)\/M because the expression inside the integral is symmetric with respect to M — ^Q^^ {e)^fM 
and <^{x) + $(— x) = 1 for any x G M. For large M, the second integral in (1481 ) can be approximated as: 



a 
a 



(a) a , — a 
Q (x) dx W - / Q{x)dx 

1(e) JQ-^ie) 2.5/X 



M I dx 

-^ti X 



Q{x)dx 



(49) 
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where (a) follows from [36]: when x is positive and large enough, Q{x) 
because ^^M^i 



e ~^ 
2.5x 



The last line holds 



a when M is sufficiently large [37]. This finally yields: 

E[X] w E[X] w M - -g-i(e)\/M - -\/M / Q{x)dx + 0.5(1 - e 

Appendix III 
PROOF OF THEOREM 3 

In order to prove the theorem, we first establish the following lemma: 
Lemma 1: If the initial rate i?init has a pre-log of r, i.e., limsNR ^' 



(50) 



lim I 
SNR^oo 



^log2(l + SNR|/li|2) < i?„ 



4 = 1 



1, 



*oo log^ SNR ~ 

for A; < r and A; G 



0, for A; > r and k G 



(51a) 
(51b) 



Proof: For notational convenience we use 7^ to denote the quantity SNR|/ijp. We prove the first 
result by using the fact that Yl^^i log2(l + 7j) < A;log2(l + maxj=i 7^) which yields: 

k 



^log2(l+7*) <-R.. 



.1=1 



> 



k log2 1 + max 7^ < i?init 

i=l,...,k 



SNR 



1-e +SNR 



(52) 



where the first equality follows because the 7i's are i.i.d. exponential with mean SNR. The exponent 
— log2(SNR) behaves as log2(SNR). If A; < r this exponent goes to infinity. Because the term 
vanishes, e is raised to a power converging to —00, and thus ( |52b converges to 1. This yields the result 
in (I51bl) . To prove (I51bl) we combine the property Yli=i log2(l + 7i) ^ ^log2(l + mini=i....,fc 7j) with 
the same argument as above: 



^log2(l + 7i) <«h 



.1=1 



< 



k log2 1 + mill 7i < i?init 

i=l,...,k 



1 - e 



fc 2 



SNR) 



If A; > r, e is raised to a power that converges to and thus we get (I51bb . 

We now move on to the proof of the theorem. Using the expression for ¥,[X] in (|2TI ) we have: 

"L-l 



lim E[X] = lim l + P[log2(l + 7i) <^imt] + --- + 
SNR^oo SNR^oo 



^log2(l+7i) < 



.1=1 



• (53) 



Because Ri^n = MC^'^ has a pre-log of M, the lemma implies that each of the terms converge to one 
and thus limgNR^o^ E[X] = M. 
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In terms of the high-SNR offset we have: 



Ihn [Cf'-(SNR)-Cf (SNR)] 
SNR^oo 



lim 

SNR-*oo 



C^^ (snr) 



Cf (SNR) 



< Inn [M-E[X]]Cf(SNR) 
SNR^oo 



(b) 



lim [M-E[X]](log2(SNR)+0(l)) 
SNR^oo 

lim [M-E[X]]log2(SNR), 
SNR^oo 



where (a) holds because E[X] > 1 and iJi^it = MC*^ (snr), and (b) holds because E[X] - 
therefore the 0(1) term does not effect the limit. 

Because the additive terms defining E[X] in (|2T]) are decreasing, we lower bound E[X] as 



E[X] > MP 



Af-l 



log2(l + 7i) < ^i. 



i=l 



> Mil 



_2W^-""=2(SNR) 1 \ 
+BNR 



M-1 



where the last inequality follows from ( [52b . Plugging this bound into ( [54l ) yields: 



lim [M - E[X]] log2(SNR) < lim M 1 - 1 - e" 

SNR^oo SNR^oo \ 



^-log^SNR 



M-l 



-2 



(54) 
M and 



(55) 



M-l 

lim -M logo (snr) 



M - 1 




where the last line follows from the binomial expansion. Because R{mi has a pre-log of M, each of the 
terms is of the form a log2(SNR)e~®^^ for some /? > and some constant a, and thus the RHS of the 
last line is zero. Because C,^'^'*^(snr) > Ci^^(SNR), this shows limsNR^oo[Cf '^^SNr) - C,^^(snr)] = 0. 



Appendix IV 
PROOF OF THEOREM 4 

In order to prove that rate optimization does not increase the high-SNR offset, we need to consider 
all possible choices of the initial rate i?init- We begin by considering all choices of R\aii with a pre-log 
of M, i.e., satisfying limsNR_,oo logfsNR ~ Because the proof of convergence of E[X] in the proof 
of Theorem 3 only requires Rmn to have a pre-log of M, we have E[X] — > M. To bound the offset, 
we write the rate as R\a^i = MC*^ (snr) — /(snr) where /(snr) is strictly positive and sub-logarithmic 
(because the pre-log is M), and thus the rate offset is: 



MCf (snr) - /(snr) 



Cf^(SNR) = (M-E[X]) 



Cf(SNR) /(SNR) 



E[X] 



E[X] 



(56) 
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By the same argument as in Appendix C, the first term is upper bounded by zero in the limit. Therefore: 



lim _ , , 
SNR^oo E[X] 



lim 

SNR^oo 



(57) 



E[X] ■ 

Relative to C*^(snr), the offset is either strictly negative (if /(snr) is bounded) or goes to negative 
infinity. In either case a strictly worse offset is achieved. 

Let us now consider pre-log factors, denoted by r, strictly smaller than M (i.e., r < M). We first 
consider non-integer values of r. By Lemma [T] the first 1+ [rj terms in the expression for E[X] converge 
to one while the other terms go to zero. Therefore E[X] ^ 1 + [rJ = [r]. The long-term transmitted 
rate, given by jgy^, therefore has pre-log equal to This quantity is strictly smaller than one, and 
therefore a non-integer r yields average rate with a strictly suboptimal pre-log factor. 

We finally consider integer values of r satisfying r < M. In this case we must separately consider 
rates of the form Rinit = r log SNR it 0(1) versus those of the form Rinn = r log SNR it o(logSNR). Here 
we use o(logSNR) to denote terms that are sub-logarithmic and that go to positive infinity; note that we 
also explicitly denote the sign of the 0(1) or o(log SNr) terms. We first consider iii^it = r log SNR ±0(1). 
By Lemma [T] the terms corresponding to A; = 0, . . . , r — 1 in the expression for K[X] converge to one, 
while the terms corresponding to A; = r + 1, . . . , M — 1 go to one. Furthermore, the term corresponding 
to A; = r converges to a strictly positive constant denoted 6: 



lim P 
SNR^oo 



lim P 
SNR-+00 



^log2(l + SNR|/lip) < rlog2(SNR) lb 0(1) 

i=l 
r 

^log2(SNR|/lip) < rlog2(SNR) ±0(1) 



.1=1 



^log2(|/l.|2)<±0(l) 



,i=l 



(58) 



where the second equality follows from [26]. 6 is strictly positive because the support of log2(|^ip), and 
thus of the sum, is the entire real line. As a result, K[X] —>■ r + 6, which is strictly larger than r. The 
pre-log of the average rate is then < 1, and so this choice of initial rate is also sub-optimal. 

If -Rinit = r log SNR + o(logSNR) the terms in the K[X] expression behave largely the same as above 
except that the k = r term converges to one because the 0(1) term in dSSl ) is replaced with a quantity 



tending to positive infinity. Therefore K[X] —>■ r + l, which also yields a sub-optimal pre-log of 



r+l 



< 1. 



We are thus finally left with the choice Rmit = r log SNR — o(logSNR). This is the same as the above 
case except that the k = r term converges to zero. Therefore K[X] —>■ r, and thus the achieved pre-log 
is one. In this case we must explicitly consider the rate offset, which is written as: 



R„ 



E[X] 



a 



M ^ r log SNR - o(log snr) _ »^ 
E[X] 



r log SNR _ 

E[X] 



o(log snr) 
E[X] 



(59) 
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Using essentially the same proof as for Theorem 3, the difference between the first two terms is upper 
bounded by zero in the limit of SNR — > oo. Thus, the rate offset goes to negative infinity. 

Because we have shown each choice of i?init (except i?init = MC^) achieves either a strictly sub- 
optimal pre-log or the correct pre-log but a strictly negative offset, this proves both parts of the theorem. 
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Fig. 1. High SNR rate offset £00 (bps/Hz) versus diversity order L for e = 0.01 




Mutual Information (bps/Hz) 



Fig. 2. CDF's of mutual information (i XlLi log2(l + SNR|/ii|^) and ^ Y.]li log2(l + SNR|/i,|^) respectively) for L = 2 
and L = 10 at SNR = 0, 10, and 20 dB 



September 17, 2009 



DRAFT 



24 





L 

Fig. 4. Ergodic capacity - e-outage capacity difference Aec - fd (bps/Hz) versus diversity order L, at SNR = 20 dB 
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Fig. 5. Ergodic capacity, H-ARQ rate, and non-H-ARQ rate (bps/Hz) versus SNR (dB) for e = 0.01 
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Fig. 6. Ergodic capacity - H-ARQ rate difference Aec-ir (bps/Hz) and ergodic capacity - non-H-ARQ rate difference Aec-fd 
(bps/Hz) versus M for e = 0.01 at SNR = 10 dB 
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Fig. 7. CDF's of accumulated mutual information over 2 and 3 rounds (random variables X]i=ilog2(l + SNR|/ii|^) and 
ELi log2(l + SNR|/iip), respectively) at SNR = 10 and 40 dB 
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Fig. 10. H-ARQ rate (bps/Hz) and non-H-ARQ rate (bps/Hz) versus outage probability e for M = 5 at SNR = and 10 and 
20 dB 
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